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Abstract. This work provides a comparison of satellite re- 
trievals of Saharan desert dust aerosol optical depth (AOD) 
during a strong dust event through March 2006. In this event, 
a large dust plume was transported over desert, vegetated, 
and ocean surfaces. The aim is to identify the differences 
between current datasets. The satellite instruments consid- 
ered are AATSR, AIRS, MERIS, MISR, MODIS, OMI, 
POLDER, and SEVIRI. An interesting aspect is that the dif- 
ferent algorithms make use of different instrument charac- 
teristics to obtain retrievals over bright surfaces. These in- 
clude multi-angle approaches (MISR, AATSR), polarisation 
measurements (POLDER), single-view approaches using so- 
lar wavelengths (OMI, MODIS), and the thermal infrared 
spectral region (SEVIRI, AIRS). Differences between instru- 
ments, together with the comparison of different retrieval 
algorithms applied to measurements from the same instru- 


ment, provide a unique insight into the performance and 
characteristics of the various techniques employed. As well 
as the intercomparison between different satellite products, 
the AODs have also been compared to co-located AERONET 
data. Despite the fact that the agreement between satellite and 
AERONET AODs is reasonably good for all of the datasets, 
there are significant differences between them when com- 
pared to each other, especially over land. These differences 
are partially due to differences in the algorithms, such as as- 
sumptions about aerosol model and surface properties. How- 
ever, in this comparison of spatially and temporally averaged 
data, it is important to note that differences in sampling, re- 
lated to the actual footprint of each instrument on the het- 
erogeneous aerosol field, cloud identification and the quality 
control flags of each dataset can be an important issue. 
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1 Introduction 

Desert dust is one of the most abundant and important 
aerosols in the atmosphere. Dust grain size and composition 
make it radiatively active over a wide spectral range (from the 
ultraviolet to the thermal infrared), and so airborne dust has a 
significant direct radiative forcing on climate (IPCC, 2007 - 
ar4 2.4.1). Changes in land use can result in an anthropogenic 
influence on the atmospheric burden of desert dust. Dust can 
affect the atmospheric dynamics through its semi-direct ra- 
diative effect, and can modify precipitation by acting as ice 
nuclei. Iron transported by desert dust and deposited into the 
sea affects phytoplankton (Jickells et al., 2005). 

Satellites can provide global measurements of desert dust 
and have particular importance in remote areas where there is 
a lack of in situ measurements. Desert dust sources are often 
in very poorly instrumented remote areas. Satellite aerosol 
retrievals have improved considerably in the last decade, 
and the number of related publications has correspondingly 
increased. However, intercomparison exercises (Myhre et 
al., 2005) have revealed that discrepancies between satellite 
measurements are particularly large during events of heavy 
aerosol loading. 

In the past, aerosol retrievals for satellite radiometers have 
typically made use of visible and near-infrared measure- 
ments, the interpretation of which becomes difficult over 
bright surfaces such as deserts (Kaufman et al., 1997). To 
overcome these difficulties, more recent algorithms make 
use of additional information available from certain instru- 
ments, for example multi-angle observations, shorter (ultra- 
violet) wavelengths, thermal infrared wavelengths, and po- 
larisation. All algorithms must also make prior assumptions 
about aerosol composition and the properties of the underly- 
ing surfaces, as the retrieval of aerosol properties is an inher- 
ently under-constrained optimisation problem. Instrumental 
observing capability and algorithm implementation (such as 
the use and formulation of prior information) give retrievals 
that are sensitive to different aspects of the dust aerosol load- 
ing. Using measurements from the same sensor, large varia- 
tions in aerosol optical depth (AOD) can be found between 
different algorithms (Kokhanovsky et al., 2007) even in the 
idealised case of a non-reflecting surface (Kokhanovsky et 
al., 2010), or when only the assumed aerosol microphysical 
properties in a retrieval algorithm are changed (e.g. Bulgin et 
al., 201 1). 

In this paper, we report results from the Desert dust Re- 
trieval Intercomparison (DRI) project, which performed a 
comparison of retrievals for a Saharan desert dust episode 
in March, 2006 using data from a wide range of state-of- 
the-art schemes. This comparison reveals differences related 
to a range of factors including details of retrieval schemes, 
sensitivity of different instruments, accuracy of the aerosol 
model assumed, and the importance of good quality con- 
trol. The aim of the study was to identify differences be- 
tween the schemes, to highlight the strengths of particular 


schemes and help algorithm developers identify areas for 
further investigation. 

The comparisons were performed separately over ocean 
(where satellite retrievals are less affected by problems in 
modelling the surface contribution to the top of atmosphere 
signal) and over land (where the retrieval problem is more 
challenging). The project also compiled a database of re- 
trieval results which can be used in future work to test al- 
gorithm improvements. 

2 Datasets 

Most of the measurements considered here gave rise to more 
than a single estimate of AOD through the application of dif- 
ferent retrieval algorithms. A pixel-by-pixel analysis of dif- 
ferent algorithms applied to the same instrument or datasets 
from collocated pixels from different instruments, as MODIS 
and MISR (Mishchenko et al., 2010; Kahn et al., 2011), 
could lead to interesting results, but we leave this to future 
work. Here the comparison of satellite datasets is limited to 
the spatially and temporally averaged data. This enables re- 
sults from a wide range of sensors to be compared, but some- 
what complicates the interpretation of differences by intro- 
ducing potentially large sampling effects. 

The different spatial and temporal sampling available from 
different satellite instruments means that a direct comparison 
at the individual pixel (field-of-view) level is generally not 
possible. These differences in sampling can give differences 
in the retrieved AOD, particularly when the aerosol loading 
is spatially and/or temporally heterogeneous, or where cloud 
fields move between the overpasses of different sensors such 
that the cloud-free area imaged is not the same (e.g. Levy et 
al., 2009; Sayer et al., 2010b). The quality control in each 
individual retrieval algorithm may be different, so even re- 
trievals from the same instrument will not necessarily have 
the same coverage. To minimise the effects of sampling dif- 
ferences on the intercomparison, data are aggregated to daily 
temporal resolution and a relatively fine spatial grid. To fa- 
cilitate comparisons, each data provider has given two sets of 
results: 

1 . A daily AOD field formed by averaging individual re- 
trievals onto a common spatial grid, namely a half de- 
gree regularly spaced grid in latitude and longitude. 
The mean AOD in each grid cell is provided along 
with the standard deviation of all individually retrieved 
AOD values in the cell and the number of these sam- 
ples. These aggregated daily fields are directly com- 
pared (neglecting the fact that satellites may sample at 
different times of day). Most algorithms provide AOD 
near 550 nm with the exception of AIRS (900 cm -1 or 
1 1 pm) and OMI-NASA (440 nm). 

2. For comparison with ground-based direct-Sun observa- 
tions from the Aerosol Robotic Network (AERONET; 
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Holben et al., 1998), we use the mean and standard devi- 
ation of all individual retrievals within a radius of 50 km 
of selected AERONET sites, together with the number 
of individual retrievals and the mean observation time 
of those samples. 

In the following text, the term “dataset” is used to refer to 
the AOD produced by the application of a named retrieval 
algorithm to measurements by a specific instrument. Com- 
parisons are restricted to a region enclosed by latitudes 0 and 
45° N and longitudes 50° W and 50° E. Table 1 summarises 
the datasets included and a brief description of each dataset 
is provided below, organised by instrument. 

The differences in using desert dust optical properties 
computed from spherical or non-spherical models can lead to 
significant effects (Mishchenko et al., 2003). In this compar- 
ison, the AATSR-ORAC, MISR, MODIS, POLDER-ocean, 
OMI-KNMI datasets include non-spherical optical models; 
the other datasets use only spherical models. This can lead to 
differences in retrieved AOD, especially for the datasets that 
make use of ultraviolet and visible wavelengths. Moreover, if 
dust is modelled assuming non-spherical particles, then addi- 
tional decisions need to be made as to the specific distribution 
of particle shape(s) to use. These differences, which can be 
significant, will also affect the calculated phase function and 
so the retrieved AOD (e.g. Kalashnikova and Sokolik, 2002; 
Kalashnikova et al., 2005). These effects are not analysed 
in the present paper (due to the complexity added by multi- 
angle retrievals), but for future research we suggest that an 
analysis of AOD differences between datasets as a function 
of scattering angle could help isolate phase function effects. 

2.1 AATSR 

2.1.1 GlobAEROSOL 

The GlobAEROSOL project (http://www.atm.ox.ac.uk/ 
project/Globaerosol/) was carried out as part of the Euro- 
pean Space Agency’s Data User Element programme. All 
the products are on a common 10 km sinusoidal grid and 
together provide almost continuous coverage for 1995-2007. 
The instruments used by the project are the second Along 
Track Scanning Radiometer (ATSR-2), the Advanced ATSR 
(AATSR), the Medium Resolution Imaging Spectrometer 
(MERIS), and the Spinning Enhanced Visible Infrared 
Imager (SEVIRI). 

The DRI intercomparison has made use of the AATSR 
GlobAEROSOL product derived using the Oxford- 
Rutherford Appleton Laboratory (RAL) Retrieval of Aerosol 
and Cloud (ORAC) optimal estimation scheme. A full 
description of the retrieval is given by Thomas et al. (2009). 
ORAC makes use of the ATSR nadir and forward view 
channels centred at 0.55, 0.67, 0.87 and 1.6 pm. The for- 
ward model includes a bidirectional reflection distribution 
function (BRDF) description of the surface reflectance. By 
constraining the relative strengths of the direct, hemispher- 


ical and bi-hemispherical surface reflectance, the aerosol 
optical depth, effective radius (Reff) and bi-hemispherical 
surface albedo in each channel are retrieved. The a priori 
surface reflectance is determined by the MODIS BRDF 
product (MCD43B1 Collection 5.0) over land (Schaaf et al., 
2002) and by an ocean surface reflectance model (Sayer et 
al., 2010a) over the ocean. 

Retrievals are performed for each of five predefined 
aerosol types: desert dust, maritime clean, continental clean, 
urban (all using component optical properties from the Op- 
tical Properties of Aerosols and Clouds (OPAC) database 
of Hess et al., 1998) and biomass-burning (Dubovik et al., 
2006). From these five results, a best match is selected based 
on the quality of the fit to the measurements and a priori con- 
straints, providing a crude speciation of the aerosol. 

Cloud screening is performed with the ESA operational 
cloud flag (Birks, 2004) and using the “opening test” (in ad- 
dition to the usual quality control measures) to get rid of 
residual cloud, as documented in ESTEC (2006). 

2.1.2 ORAC 

The AATSR-ORAC dataset represents an updated ver- 
sion of the aerosol retrieval algorithm used in AATSR- 
GlobAEROSOL. Three major aspects of the algorithm have 
been improved, described in detail by Lean (2009) and Sayer 
et al. (2012): 

- Improved surface reflectance treatment. The error bud- 
get of the MODIS BRDF products used to generate the 
a priori surface albedo has been improved, and a cor- 
rection algorithm applied to account for the differences 
between the visible channel spectral response functions 
of the MODIS and AATSR instruments. 

- Implementation of aerosol type flags (volcanic ash, 
biomass burning over land, desert dust over sea) to iden- 
tify aerosol pixels misclassified as cloudy by the sup- 
plied cloud flag. 

- Development of a new aerosol microphysical model 
for desert dust. This uses the same refractive indices 
(derived from OPAC components) as in the AATSR- 
GlobAEROSOL retrieval, but treats the particles as 
spheroids using T-matrix code (Mishchenko et al., 1997, 
1998) rather than spheres. A modified log-normal distri- 
bution of spheroid aspect ratios (the ratio between major 
and minor axis length) as given by Sect. 3.4 of Kan- 
dler (2007) is used with equal numbers of oblate and 
prolate spheroids. 

Cloud screening is performed with the ESA operational 
cloud flag (Birks, 2004). 

2.1.3 Swansea 

The Swansea University retrieval algorithm has been de- 
signed to retrieve the aerosol optical thickness and type, 
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Table 1 . List of the different datasets participating in the intercomparison, divided by instrument. The datasets are flagged with a cross for 
retrieval over land, over ocean and in comparison with AERONET sites. 


SEVIRI 

Time UTC 

Retrieval over: Ocean 

Land 

AERONET 

ORAC 

12:12 

X 

X 

X 

Glob AERO SOL 

10:00 13:00 16:00 

X 

X 

X 

Imperial VIS 

12:12 

X 



Imperial IR 

12:12 


X 

X 

AATSR 

Orbit local time 




ORAC 

10:00 

X 

X 

X 

Glob AERO SOL 

10:00 

X 

X 

X 

Swansea 

10:00 

X 

X 

X 

AIRS 





JCET 

13:30 

X 

X 


OMI 





NASA-GSFC 

13:30 

X 

X 

X 

KNMI 

13:30 

X 

X 

X 

MISR 





JPL-GSFC 

10:30 

X 

X 

X 

MERIS 





LOV 

10:00 

X 


X 

SEAWIFS 





LOV 

12:20 

X 


X 

MODIS 





NASA-GSFC 

10:30 13:30 


X 

X 

POLDER 





Ocean 

13:30 

X 


X 

Land 

13:30 


X 

X 


and surface reflectance over both land and ocean. The treat- 
ment of atmospheric radiative transfer is by look-up table 
(LUT) using the scalar version of 6S code (Vermote et al., 
1997; Grey et al., 2006a). Five aerosol models are repre- 
sented: two coarse modes (oceanic, desert) and three fine 
mode (biomass burning, continental and urban). The opti- 
mum value of AOD and aerosol model is selected by iter- 
ative inversion based on fit to a model of surface reflectance. 
Over ocean, the algorithm uses the low spectral reflectivity 
at near and mid-infrared channels to constrain aerosol re- 
trieval (Grey et al., 2006b; Bevan et al., 2012). Over land, 
the algorithm uses the AATSR dual-view capability to esti- 
mate aerosol without prior assumptions of land surface spec- 
tral properties, based on inversion of a simple parametrized 
model of surface anisotropy (North et al., 1999; North, 2002; 
Davies et al., 2010). This model defines spectral variation 
of reflectance anisotropy accounting for variation in diffuse 
light from the atmosphere and multiple scattering at the sur- 
face. Cloud clearing is based on instrument flags enhanced by 
the cloud detection system developed by Plummer (2008). 


The retrieval procedure was implemented within ESA’s 
Grid Processing on Demand (GPOD), high-performance 
computing facility for global retrievals of AOD and bi- 
directional reflectance from ATSR-2 and AATSR, at 10 km 
resolution, and these data are used in the current study. 
Global validation with AERONET and other satellite sen- 
sors was presented by Grey et al. (2006b) and Bevan et 
al. (2012). Bevan et al. (2009) performed validation of GPOD 
ATSR-2 and explored the impact of atmospheric aerosol 
from biomass burning in the Amazon region over the full 13- 
yr ATSR-2/AATSR dataset. Further details on the algorithm 
are given in Grey and North (2009). 

2.2 AIRS 

2.2.1 JCET 

Operational since September 2002, the Atmospheric In- 
frared Sounder (AIRS) instrument (Aumann et al., 2003) on 
NASA’s Aqua satellite provides data for temperature and hu- 
midity profiles, used in numerical weather prediction. AIRS 
has 2378 channels, covering the spectral range 649-1136, 
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1217-1613, 2181-2665 cm -1 . Each cross track swath con- 
sists of 90 pixels, with a footprint of 15 km at nadir. 

Upwelling radiances in the 8-12 pm thermal infrared 
(TIR) atmospheric window are measured with a large num- 
ber of high-resolution, low noise channels, making it possible 
to detect silicate-based aerosols (De Souza-Machado et al., 
2006, 2010) day or night, over ocean or land. A dust detec- 
tion algorithm has been developed using brightness temper- 
ature differences (BTDs) for a set of 5 AIRS channels in the 
TIR region. The algorithm is based on simulations of dust- 
contaminated radiances for numerous atmospheric profiles 
over ocean using dust refractive indices from Volz (1973). 
This flag was designed to detect dust over tropical and mid 
latitude oceans (which have no cloud cover over the dust), 
and can be modified to work over land surfaces. 

The retrieval uses a modified version of the AIRS Radia- 
tive Transfer Algorithm (AIRS-RTA), which computes radia- 
tive transfer through a dusty atmosphere (Chou et al., 1999). 
The AIRS-RTA assumes a plane parallel atmosphere divided 
into 100 layers, with the dust profile occupying one or more 
consecutive pressure layers. 

The algorithm assumes knowledge of the effective particle 
size and dust top/bottom height. Here an effective particle di- 
ameter of 4 pm for a log-normal distribution is adopted. The 
dust height comes from GOCART climatology (Ginoux et 
al., 2001). Given this, a linearised Newton-Raphson method 
fits for the column dust loading T (in gm 2 ) to minimise a 
X 2 least square fit of brightness temperatures (BTs) in the 
window regions. The dust loading is related to the TIR dust 
AOD r by 

T (f ) = CTdust model(U r mode)k . (1) 

Here o^ust model Oh r mo de) is the mass extinction efficiency in 
m 2 g“ 1 . It is important to note that the retrieved TIR AOD 
depends critically on the assumed particle height. Compar- 
isons show that, when the heights are correct, AIRS AODs 
have a very high correlation against MODIS and POLDER 
AODs, especially over the ocean (De Souza-Machado et al., 
2010). This correlation drops noticeably when the heights are 
incorrect. 

2.3 OMI 

2.3.1 NASA-GSFC 

The first step in the OMAERUV algorithm is the calcula- 
tion of the UV Aerosol Index (UVAI) as described in Torres 
et al. (2007). The information content of the OMI UVAI is 
turned into quantitative estimates of aerosol extinction opti- 
cal depth and single scattering albedo (SSA) at 388 nm by 
application of an inversion algorithm to OMI near-UV ob- 
servations at 354 and 388 nm (Torres et al., 2007). These 
aerosol parameters are derived by an inversion algorithm that 
uses pre-calculated reflectances for a set of assumed aerosol 
models. A climatological dataset of near-UV surface albedo 


derived from long-term TOMS (Total Ozone Mapping Spec- 
trometer) observations is used to characterise surface reflec- 
tive properties. Three major aerosol types are considered: 
desert dust, carbonaceous aerosols associated with biomass 
burning, and weakly absorbing sulfate-based aerosols. The 
selection of an aerosol type makes use of a combination of 
spectral and geographic considerations (Torres et al., 2007). 
The aerosol model particle size distributions were derived 
from long-term AERONET statistics (Torres et al., 2007). 

Since the retrieval procedure is sensitive to aerosol verti- 
cal distribution, the aerosol layer height is assumed based on 
aerosol type and geographic location. Carbonaceous aerosol 
layers within 30° N of the Equator are assumed to have a 
maximum concentration 3 km above ground level, whereas 
mid and high-latitude (polewards of 45° N) smoke layers are 
assumed to peak at 6 km. The height of smoke layers between 
30° and 45° latitude in both hemispheres is interpolated with 
latitude between 3 and 6 km. The location of desert dust 
aerosol layers varies between 1.5 and 10 km, and is given by 
a multi-year climatological average of chemical model trans- 
port calculations using the GOCART model at a lat-long res- 
olution of 2° x 2.5° (Ginoux et al., 2001). For sulfate-based 
aerosols, the assumed vertical distribution is largest at the 
surface and decreases exponentially with height. 

For a chosen aerosol type and assumed aerosol layer 
height, the extinction optical depth and single scattering 
albedo at 388 nm are retrieved and aerosol absorption opti- 
cal depth is calculated. Results are also reported at 354 and 
500 nm to facilitate comparisons with measurements from 
other space-borne and ground-based sensors. 

Aerosol parameters over land are retrieved for all cloud- 
free scenes as determined by an internal cloud mask. Re- 
trievals over the ocean, however, are limited to cloud-free 
scenes containing absorbing aerosols (i.e. smoke or desert 
dust) as indicated by UVAI values larger than unity. Since 
the current representation of ocean surface effects in the 
OMAERUV algorithm does not explicitly correct for ocean 
colour signal, the retrieval of accurate background maritime 
aerosol is not currently possible. 

Algorithm quality flags are assigned to each pixel. Most 
reliable OMAERUV retrievals have a quality flag 0. Quality 
flag 1 indicates sub-pixel cloud contamination. For quanti- 
tative applications using OMAERUV-derived aerosol optical 
depth and single scattering albedo, only data of quality flag 0 
are recommended. For this comparison flag 0, data have been 
extrapolated to 440 nm. 

2.3.2 KNMI 

The OMI multi-wavelength algorithm OMAERO (Torres et 
al., 2002) is used to derive aerosol characteristics from OMI 
spectral reflectance measurements of cloud-free scenes. Un- 
der cloud-free conditions, OMI reflectance measurements are 
sensitive to the aerosol optical depth, the single scattering 
albedo, the size distribution, altitude of the aerosol layer, 
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and the reflective properties of the surface. However, from a 
principal-component analysis applied to synthetic reflectance 
data (Veihelmann et al., 2007), it was shown that OMI spectra 
contain only two to four degrees of freedom of signal. Hence, 
OMI spectral reflectance measurements do not contain suffi- 
cient information to retrieve all aerosol parameters indepen- 
dently. The OMAERO level-2 data product reports aerosol 
characteristics such as the AOD, aerosol type, aerosol ab- 
sorption indices as well as ancillary information. The AOD is 
retrieved from OMI spectral reflectance measurements, and a 
best-fitting aerosol type is determined. The single scattering 
albedo, the layer altitude and the size distribution associated 
with the best-fitting aerosol type are reported. 

Cloudy scenes are excluded from the retrieval using three 
tests. The first test is based on reflectance data in combina- 
tion with the UV absorbing aerosol index. The second test 
uses cloud fraction data from the OMI 02-02 cloud prod- 
uct 0MCLD02 (Acarreta and Hann, 2002; Acarreta et al., 
2004; Sneep et al., 2008). The third test is based on the spa- 
tial homogeneity of the scene. The latter test is the most 
strict for screening clouds in the current implementation of 
the algorithm. 

The OMAERO algorithm evaluates the OMI reflectance 
spectrum in a set of 15 wavelength bands in the spectral 
range between 330 and 500 nm. The wavelength bands are 
about 1 nm wide and were chosen such that they are essen- 
tially free from gas absorption and strong Raman scattering 
features, except for a band at 477 nm, which comprises an 
02-02 absorption feature. The sensitivity to the layer alti- 
tude and single scattering albedo is related to the relatively 
strong contribution of Rayleigh scattering to the measured 
reflectance in the UV (Torres et al., 1998). The absorption 
band of the 02-02 collision complex at 477 nm is used in 
OMAERO to enhance the sensitivity to the aerosol layer al- 
titude (Veihelmann et al., 2007). 

The multi-wavelength algorithm uses forward calculations 
for a number of microphysical aerosol models that are de- 
fined by the size distribution and the complex refractive 
index, as well as the AOD and the aerosol layer altitude. 
The models are representative for the main aerosol types of 
desert dust, biomass burning, volcanic and weakly absorb- 
ing aerosol. Several sub-types or models represent each of 
these main types. Synthetic reflectance data have been pre- 
computed for each aerosol model using the Doubling-Adding 
KNMI program (De Haan et al., 1987; Stammes et al., 1989; 
Stammes, 2001), assuming a plane-parallel atmosphere and 
taking into account multiple scattering as well as polarisa- 
tion. For land scenes, the surface albedo spectrum is taken 
from a global climatology that has been constructed using 
Multi-angle Imaging Spectroradiometer (MISR) data mea- 
sured in four bands (at 446, 558, 672, and 866 nm) that are 
extrapolated to the UV. For ocean surfaces, the spectral bidi- 
rectional reflectance distribution function is computed using 
a model that accounts for the chlorophyll concentration of 


the ocean water and the near-surface wind speed (Veefkind 
and de Leeuw, 1998). 

For each aerosol model, an AOD is determined by min- 
imising the x 2 merit function obtained with the spectra of 
measured reflectances, the computed reflectances (function 
of the AOD), and the error in the measured reflectances. 

The aerosol model with the smallest value of x 2 is se- 
lected, and the corresponding AOD at 14 different wave- 
lengths is reported as the retrieved AOD. Other reported pa- 
rameters are the single scattering albedo, the size distribution 
and the aerosol altitude that are associated with the selected 
aerosol model. 

Aerosol models are post-selected based on a climatology 
of geographical aerosol distribution (Curier et al., 2008). The 
accuracy of the AOD retrieved by the OMAERO algorithm 
is estimated to be larger than 0.1 or 30 % of the AOD value. 
This is an error estimate that was also used for the TOMS 
aerosol algorithm (Torres et al., 2005). More information on 
the OMAERO algorithm and data product may be found in 
Torres et al. (2007). 

2.4 MISR 

2.4.1 JPL/GSFC 

The Multi-angle Imaging SpectroRadiometer (MISR) was 
launched into a sun-synchronous polar orbit in Decem- 
ber 1999, aboard the NASA Earth Observing System’s Terra 
satellite. MISR measures upwelling short-wave radiance 
from Earth in four spectral bands centred at 446, 558, 672, 
and 866 nm, at each of nine view angles spread out in the for- 
ward and aft directions along the flight path, at 70.5°, 60.0°, 
45.6°, 26.1°, and nadir (Diner et al., 1998). Over a period 
of 7 min, as the spacecraft flies overhead, a 380-km-wide 
swath of Earth is successively viewed by each of MISR’s 
nine cameras. As a result, the instrument samples a very large 
range of scattering angles (between about 60° and 160° at 
mid-latitudes), providing information about aerosol micro- 
physical properties. These views also capture air-mass fac- 
tors ranging from one to three, offering sensitivity to opti- 
cally thin aerosol layers, and allowing aerosol retrieval algo- 
rithms to distinguish surface from atmospheric contributions 
to the top-of-atmosphere (TOA) radiance. Global coverage 
(to ±82° latitude) is obtained about once per week. 

The MISR standard aerosol retrieval algorithm reports 
AOD and aerosol type at 17.6 km resolution, by analysing 
data from 16x16 pixel regions of 1 . 1 km-resolution, MISR 
top-of-atmosphere radiances (Kahn et al., 2009a). Over dark 
water, operational retrievals are performed using the 672 and 
867 nm spectral bands, assuming a Fresnel-reflecting surface 
and standard, wind-dependent glint and whitecap ocean sur- 
face models. Coupled surface-atmosphere retrievals are per- 
formed using all four spectral bands over most land, includ- 
ing bright desert surfaces (Martonchik et al., 2009), but not 
over snow and ice. 
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MISR AOD has been validated and used over many desert 
surfaces (Martonchik et al., 2004; Christopher et al., 2008, 
2009; Kahn et al., 2009b; Koven and Fung, 2008; Xia et al., 
2008; Xia and Zong, 2009), as well as other less challeng- 
ing environments. Sensitivity to AOD and particle proper- 
ties varies with conditions; at least over dark water, under 
good retrieval conditions and mid-visible AOD larger than 
about 0.15, MISR can distinguish about three-to-five group- 
ings based on particle size, two-to-four groupings in single 
scattering albedo (SSA), and spherical vs. non-spherical par- 
ticles (Chen et al., 2008; Kalashnikova and Kahn, 2006). 
The algorithm identifies all mixtures that meet the accep- 
tance criteria from a table of mixtures, each composed of up 
to three aerosol components; the same mixture table is ap- 
plied for all seasons and locations, over both land and water. 
Version 22 of the MISR Standard Aerosol Product, used in 
this study, contains 74 mixtures and eight components (Kahn 
et al., 2010 ), including a medium-mode, non-spherical dust 
optical analogue developed from aggregated, angular shapes 
and a coarse-mode dust analogue composed of ellipsoids 
(Kalashnikova et al., 2005). 

Cloud screening in the MISR aerosol retrieval algorithm 
is conservative by design, and includes ( 1 ) a radiometric, 
angle-by-angle reflectance mask with spatially and tempo- 
rally varying reflectance thresholds, ( 2 ) a reflectance-feature 
elevation mask based on stereo-derived heights, (3) a re- 
flectance angular signature cloud mask, (4) an angle-to-angle 
smoothness test, and (5) and an angle-to-angle spatial corre- 
lation test (Martonchik et al., 2009). 

2.5 MERIS and SeaWiFS 

2.5.1 LOV 

The MERIS algorithm (Antoine and Morel, 1999) is a full 
multiple scattering inversion scheme using aerosol models 
and pre-computed look-up tables (LUTs). It uses the path re- 
flectances in the near infrared, where the contribution of the 
ocean is null, as well as visible reflectances, where the marine 
contribution is significant and varying with the chlorophyll 
content of oceanic water. A technique was proposed by No- 
bileau and Antoine (2005) to overcome the difficulty in dis- 
criminating between absorbing and non-absorbing aerosols. 
In the present regional application, a climatology is used for 
water reflectance and error as described in Antoine and No- 
bileau (2006). After absorption has been detected, the atmo- 
spheric correction is restarted using specific sets of absorb- 
ing aerosol models (i.e. specific LUTs). The aerosol optical 
thickness at all wavelengths and the Angstrom exponent are 
then derived. 

For non-absorbing aerosol, a set of 12 aerosol models 
is used from Shettle and Fenn (1979) and Gordon and 
Wang (1994). This set includes four maritime aerosols, four 
rural aerosols that are made of smaller particles, and four 
coastal aerosols that are a mixing between the maritime and 


the rural aerosols. The mean particle sizes of these aerosols, 
and thus their optical properties, vary as a function of the rel- 
ative humidity, which is set to 50, 70, 90 and 99 % (hence 
the 3 times four models). In addition to these boundary- 
layer aerosols, constant backgrounds are introduced in the 
free troposphere (2-12 km), with a continental aerosol AOD 
of 0.025 at 550 nm (WCRP, 1986) and in the stratosphere 
(12-30 km), with H 2 SO 4 aerosol AOD of 0.005 at 550 nm 
(WCRP, 1986). 

For the absorbing case, the look-up tables use the six 
dust models and the three vertical distributions proposed by 
Moulin et al. (2001), which were derived as the most ap- 
propriate to reproduce the TOA total radiances recorded by 
SeaWiFS above thick dust plumes off western Africa. The 
mean Angstrom exponent of these models is about 0.4 when 
computed between 443 and 865 nm. When these aerosols are 
present, a background of maritime aerosol is maintained, us- 
ing the Shettle and Fenn (1979) maritime model for a relative 
humidity of 90 % and an optical thickness of 0.05 at 550 nm 
(Kaufman et al., 2001). The backgrounds in the free tropo- 
sphere and the stratosphere are unchanged. 

A specific test using the band at 412 nm was developed 
in order to eliminate clouds without eliminating thick dust 
plumes (see also Nobileau and Antoine, 2005), which are 
quite bright in the near infrared and therefore are eliminated 
when using a low threshold in this wavelength domain (as 
done for instance in the standard processing of the SeaW- 
iFS observations). The same algorithm is applied to SeaW- 
iFS. In this case, specific look-up tables are used that corre- 
spond to the SeaWiFS band set. This is the only difference as 
compared to the MERIS version. 

2.6 MODIS 

2.6.1 NASA-GSFC 

In this intercomparison, the Deep Blue retrievals (Hsu et 
al., 2004, 2006) have been considered, and this dataset in- 
cludes only data over land. The principal concept behind the 
Deep Blue algorithm’s retrieval of aerosol properties over 
surfaces such as arid and semi-arid takes advantage of the 
fact that, over these regions, the surface reflectance is usu- 
ally very bright in the red part of the visible spectrum and 
in the near infrared, but is much darker in the blue spectral 
region (i.e. wavelength less than 500 nm). In order to infer 
atmospheric properties from these data, a global surface re- 
flectance database of 0 . 1 ° latitude by 0 . 1 ° longitude reso- 
lution was constructed over land surfaces for visible wave- 
lengths using the minimum reflectivity technique (for exam- 
ple, finding the clearest scene during each season for a given 
location). For MODIS collection 5.1 Deep Blue products, the 
surface BRDF effects are taken into account by binning the 
reflectivity values into various viewing geometries. 

Cloud masks used in the Deep Blue algorithm are different 
from the standard MODIS cloud masks. They are generated 
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internally and consist of three steps: (1) determining the spa- 
tial variance of the 412 nm reflectance; (2) using the visible 
aerosol index (412-470 nm) to distinguish heavy dust from 
clouds; and (3) detecting thin cirrus based on the 1.38 mi- 
cron channel reflectance. After cloud screening, the aerosol 
optical depth and aerosol type are then determined simul- 
taneously in the algorithm using look-up tables to match 
the satellite-observed spectral radiances. The final products 
include spectral aerosol optical depth, Angstrom exponent, 
as well as single scattering albedo for dust. More informa- 
tion on the Deep Blue algorithm can be found at Hsu et 
al. (2004, 2006). 

2.7 SEVIRI 

2.7.1 GlobAEROSOL 

The DRI intercomparison has made use of the SEVIRI 
GlobAEROSOL product. This is derived using the Oxford- 
RAL Aerosol and Cloud optimal estimation retrieval scheme. 
A full description of the retrieval is given by Thomas (2009). 
It makes use of the 0.64, 0.81 and 1.64 micron channels of 
SEVIRI at 10:00, 13:00 and 16:00 UTC. The forward model 
includes a BRDF description of the surface reflectance, and, 
by constraining the relative strengths of the direct, hemi- 
spherical and bi-hemispherical surface reflectance to a priori 
values, the aerosol optical depth, effective radius and the sur- 
face reflectance in each channel can be retrieved. The a pri- 
ori surface reflectance is determined by the 16-day MODIS 
BRDF product over land and by an ocean surface reflectance 
model over the ocean. 

Retrievals are done for each of five predefined aerosol 
types: desert dust, maritime clean, continental clean, and ur- 
ban, all using components properties from the Optical Prop- 
erties of Aerosols and Clouds (OPAC) database (Hess et 
al., 1998) and biomass-burning (from Dubovik et al., 2006). 
From these five results, a best match is selected based on the 
quality of the fit to the measurements and a priori constraints, 
providing a crude speciation of the aerosol. 

Cloud screening is performed with the standard EUMET- 
SAT flag (EUMETSAT, 2007) and using the “opening test” 
(in addition to the usual quality control measures) to get rid 
of residual cloud, as documented in ESTEC (2006). 

2.7.2 ORAC 

The SEVIRI-ORAC dataset represents an updated ver- 
sion of the aerosol retrieval algorithm used in SEVIRI- 
GlobAEROSOL. The main difference is the addition of in- 
frared channels that improve the retrieval over bright sur- 
faces. A simultaneous aerosol retrieval that considers the 
visible, near-infrared and mid-infrared channels (0.64, 0.81, 
1.64, 10.78, 1 1.94 micron) is used, as described in detail by 
Carboni et al. (2007). 


The main difference from the GlobAEROSOL algorithm 
is the addition of two IR channels around 1 1 and 12 microns 
(assuming surface emissivity equal to ocean emissivity). For 
these infrared channels, ECMWF profile and skin tempera- 
ture are used to define the clear sky atmospheric contribution 
to the signal. Together with AOD at 550 nm and effective 
radius, the altitude of the aerosol layer and surface tempera- 
ture are part of the state vector of retrieved parameters. The 
retrieval is performed only with the desert dust aerosol class 
(spherical particles): this will produce errors in non-dust con- 
ditions, and in particular will produce an overestimation of 
AOD in clean conditions and more scattering aerosol type 
(non-dust). In this dataset, only the SEVIRI scenes acquired 
at 12: 12 UT are analysed to allow the maximum thermal con- 
trast and with no need for interpolation of ECMWF data. 

A data cut is then performed, excluding pixels that result 
in AOD greater than 4.9, AOD less the 0.01, effective radius 
greater the 3 pm, brightness temperature difference at 1 1-12 
microns greater than 1.2 K, cost function greater than 15 and 
pixels where the retrieval is not converging. 

2.7.3 IMPERIAL 

Two different retrieval schemes are employed depending on 
whether the SEVIRI observations are taken over land or 
over ocean. In both cases, retrievals are only performed if 
the scene is designated non-cloudy. Over ocean, the cloud 
detection scheme described by Ipe et al. (2004) is utilised 
in conjunction with a subsequent test to restore any dusty 
points incorrectly flagged as cloud (Brindley and Russell, 
2006). Over land, the scheme of Ipe et al. (2004) is sup- 
plemented by the cloud detection due to Derrien and Le 
Gleau (2005). Again, dusty points incorrectly flagged as 
cloud are restored based on the threshold tests developed un- 
der the auspices of the Satellite Application Facility for Now- 
casting (Meteofrance, 2005). 


Imperial VIS 

Over ocean, optical depths at 0.6, 0.8 and 1.6 microns are ob- 
tained independently from the relevant channel reflectances 
according to the algorithm described in Brindley and Ig- 
natov (2006). Briefly, this scheme involves the use of re- 
flectance look-up tables (LUTs) derived as a function of 
solar/viewing geometry and aerosol optical depth. For a 
given sun-satellite geometry and channel, the retrieved op- 
tical depth is that which minimises the residual between 
the observed and simulated reflectance. One fixed “semi- 
empirical” aerosol model is used in the construction of 
the LUTs, matching the representation originally employed 
in the retrieval scheme developed for the Advanced Very 
High Resolution Radiometer (AVHRR) (Ignatov and Stowe, 
2002). Using the optical depths derived from the differ- 
ent channels, one can also obtain estimates of Angstrom 
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coefficients: these can subsequently be used to scale the re- 
trievals to alternative wavelengths as required. De Paepe et 
al. (2008) show that retrievals using this method exhibit RMS 
differences with co-located MODIS optical depths that are 
typically less than 0. 1 . 


Imperial IR 

Over land, the lack of contrast between aerosol and sur- 
face reflectance in the solar bands makes it difficult to use 
these alone to obtain a quantitative measure of aerosol load- 
ing. Instead, a relatively simple method is used that relates 
dust-induced variations in SEVIRI 10.8 and 13.4 micron 
brightness temperatures to the visible optical depth (Brind- 
ley and Russell, 2009). This technique essentially builds on 
the method originally developed for Meteosat by Legrand et 
al. (2001), but attempts to eliminate the impact of variations 
in the background atmospheric state on the brightness tem- 
perature and hence optical depth signal. Comparisons with 
co-located AERONET and aircraft measurements (Brindley 
and Russell, 2009; Christopher et al., 201 1) indicate a maxi- 
mum uncertainty of ~ 0.3. 

2.8 POLDER/PARASOL 

The instrument on the PARASOL platform (Polarization and 
Anisotropy of Reflectances for Atmospheric Science coupled 
with Observations from a Lidar), which is the second in the 
CNES Myriade line of microsatellites, is largely based on the 
POLDER instrument (Deschamps et al., 1994). The charge- 
coupled device (CCD) has been rotated by 90° to allow a 
larger scattering angle range, and the spectral range (440 to 
910 nm) has been extended up to 1020 nm. Its two main fac- 
tors are the ability to measure the linear polarisation of the 
radiance in three spectral bands, 490, 670 and 865 nm, and to 
acquire the directional variation of the total and polarized re- 
flected radiance. The instrument concept is based on a wide 
field of view lens and a bi-dimensional CCD that provides 
an instantaneous field of view of ±5 1° along-track and ±43° 
cross-track. As the instrument flies over the target, up to 16 
views are acquired which can be composed to infer the direc- 
tional signature of the reflectance. This signature provides in- 
formation on the surface, aerosol, and cloud characteristics. 
A limitation of POLDER is the rather crude spatial resolu- 
tion of about 6 km. The POLDER instrument flew on-board 
the ADEOS 1 and 2 platforms in 1996-1997 and 2003, re- 
spectively. Unfortunately, due to the failure of the satellite 
solar panels, the measurement time series are limited to re- 
spectively 8 and 7 months. The microsatellite PARASOL was 
launched in December 2004; it is still operating and has been 
part of the A-train since December 2009. 

Algorithms have been developed to process the sun ra- 
diances reflected by the Earth’s surface and atmosphere 
in terms of aerosol products (Deuze et al., 2001; Herman 


et al., 2005). We describe in more detail how the spe- 
cific characteristics of POLDER have been used to retrieve 
aerosol properties. 

2.8.1 Aerosol over the oceans 

The combination of spectral-directional and polarized signa- 
ture provides a very strong constraint to invert the aerosol 
load and characteristics. The present algorithm (Herman et 
al., 2005) assumes spherical or non-spherical particles, non- 
absorbing particles, and the size distribution follows a com- 
bination of two log-normal aerosol size distributions in the 
accumulation and coarse modes respectively. In a first step, 
the retrieval of optical depth and size distribution is achieved 
using radiance measurements in two aerosol channels, 670 
and 865 nm. When the geometrical conditions are optimum, 
i.e. when the scattering angle coverage is larger than 125°- 
155°, the shape (spherical or not) of the particles is derived. 
In a second step, the refractive index retrieval is attempted 
from the polarisation measurements. 

Comparisons with AERONET measurements show very 
good agreement, with typical RMS errors less than 0.10, in- 
cluding errors due to cloud cover or time difference acquisi- 
tion within ±1 h, with no significant bias. With an additional 
removal of cloud-contaminated cases, the statistical RMS er- 
ror is close to 0.03. The fine mode optical depth can also 
be compared to AERONET measurements, albeit with some 
uncertainty on the aerosol radius cut-off. Statistical results 
indicate a low bias of 0.02 with a standard deviation of 0.02. 

The combination of spectral, directional and polarisation 
information has been used to attempt a retrieval of the aerosol 
refractive index over the oceans. The results indicate that, 
when the coarse mode is spherical, the refractive index is 
close to that of water (1.35), indicating hydrated particles. 
When the coarse mode is mostly non-spherical, however, the 
retrieval is found to be inconclusive. As for the fine mode, 
the inverted refractive index is generally found between 1 .40 
and 1.45, with no clear spatial distributions. 

2.8.2 Aerosol over land 

The retrieval of aerosol load properties over land surface is 
based on polarized reflectance measurements. When the sur- 
face reflectance is generally larger than that generated by 
aerosols, which makes quantification difficult from radiance 
measurements alone, the polarized reflectance of land sur- 
faces is moderate and spectrally constant, although with a 
very strong directional signature (Nadal and Breon, 1999). 
On the other hand, scattering by submicron aerosol parti- 
cles generates highly polarized radiance (Deuze et al., 2001), 
which makes it possible to estimate the corresponding load. 
Nevertheless, larger aerosol particles, such as desert dust, do 
not nearly polarize sunlight and are therefore not accessible 
to a quantitative inversion from POLDER measurements. In 
addition, the polarized reflectance of bright surfaces is larger 
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Table 2. Summary of dataset main characteristics: assumptions, cloud screening, retrieved parameters besides the AOD at 550 nm and the 
spectral range together with other mean features of the instrument that have been used (for more details see individual algorithm description 
in Sect. 2). 


DATASET 

Assumptions 

Cloud screening 

Parameters retrieved 

Spectral range 

AATSR-GLOB 

Over land MODIS-BRDF as a priori 

ESA operational cloud flag, 
opening test 

Reff, 

Aerosol type, 

bi-hemispheric albedo (eh) 

VIS-NIR, 2 views 

AATSR-ORAC 

Over land MODIS-BRDF as a priori 

ESA operational cloud flag 

Reff 

Aerosol type, 

bi-hemispheric albedo (eh) 

VIS-NIR, 2 views 

AATSR-SWA 

Reff 

GLOBCARBON cloud detection system 

Aerosol type 
surface reflectance (eh) 

VIS-NIR, 2 views 

AIRS 

Height, 

Reff 

BTD 

AOD(lOpm) 

TIR 

MERIS-LOV 

Fixed particle size (varies with the 
humidity) 

Test at 412 nm 

Chlorophyll content 

VIS-NIR 

MISR 


angle-by-angle reflectance mask, 
elevation mask based on stereo-derived heights, 
reflectance angular signature cloud mask, 
angle-to-angle smoothness test, 
angle-to-angle spatial correlation test 

Aerosol type, 

mixture of components, 

spherical vs. non-spherical particles 

VIS, 9 views 

MODIS 

Global surf, reff dataset + BRDF 

spatial variance at 412 nm, 

visible aerosol index (412-470 nm), 
1.3, pm to detect cirrus 


VIS, Deep Blue 
wavelengths 

OMI-KNMI 

Land surf. refl. From MISR data 

reflectance and UV AAI 
02-02 cloud product 
spatial homogeneity 

Aerosol type 

SSA 

height 

size distribution of the best fit 

UV-VIS 

OMI-NASA 

TOMS surf. refl. 

dust height from GOCART 

Internal cloud mask over land 
UVAI > 1 over ocean 

AOD (388 nm) 
SSA (388 nm) 

UV 

POLDER-LAND 

log-normal size distribution (fine), 

combination of a priori 
surface BRDF 

thresholds (total and polarized reflectances), 
detection of the polarized rainbow, 
apparent pressure (02 absorption band) 

Angstrom coeff. 

VIS-NIR, up to 16 
views 

normal and polar- 
ized channels 

POLDER-OCEAN 

combination of two 
log-normal 

size distributions (fine and coarse) 

thresholds (total and polarized reflectances), 
detection of the polarized rainbow, 
spatial variability of reflectance 

Angstrom coeff, 
Reff 

VIS-NIR, up to 16 
views 

normal and polar- 
ized channels 

SEAWIFS 

Fixed particle size (varies with hu- 
midity) 

Test at 412 nm 

Chlorophyll content 

VIS-NIR 

SEVIRI-IMP-IR 

Fixed aerosol model, 
ECMWF data 

Cloud detection scheme, 
test to restore dust points 


TIR 

SEVIRI-IMP-VIS 

Fixed aerosol model, 
Fixed BRDF 

Cloud detection scheme, 
test to restore dust points 

Angstrom coeff. 

VIS 

SEVIRI-GLOB 

Over land MODIS-BRDF as a priori 

EUMETSAT cloud flag, 
opening test 

Reff, 

aerosol type, 

bi-hemispherical albedo (550 nm) 

VIS-NIR 

SEVIRI-ORAC 

ECMWF profiles, 

ECMWF skin temperature as a priori, 
over land MODIS-BRDF as a priori 

Data cut for AOD, Reff, BTD and cost function 

Reff, 

bi-hemispherical albedo (550 nm), 
height, 

surface temperature 

VIS-NIR-TIR 
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Fig. 1. Image of AOD of the different datasets corresponding to 8 March 2006. 
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Fig. 2. Image of monthly mean AOD of the different datasets for March 2006. 
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Fig. 3. Location and symbol of the AERONET sites. Every site has 
a different symbol, consistent with the following AERONET plots: 
open for coast sites, closed for land sites. 


than over vegetated areas, which makes the dust retrieval 
very challenging. For very strong events dust can bias the 
accumulation mode retrieval. The retrievals from POLDER 
measurements show that submicron particles are dominant 
in regions of biomass burning as well as over highly pol- 
luted areas (Tanre et al., 2001). The continuity at the land/sea 
boundaries is observed in most regions, which gives us good 
confidence in the quality of the inversions. 

Over land, the evaluation of POLDER retrievals is made 
against the fine mode optical depth derived from AERONET 
measurements. The results show no significant bias and an 
RMS error on the order of 0.05 when dust loaded atmosphere 
is excluded (i.e. a validation in regions affected by biomass 
burning or pollution aerosols). 

Table 2 summarises the principal features of these datasets 
in terms of main assumptions, cloud screening, other param- 
eters retrieved together with the AOD and the spectral range 
and mean features of the instruments that have been used. 


3 Results of individual datasets 

Figure 1 shows the 550 nm AOD for 8 March 2006. This day 
is a good example of a desert dust plume extending over both 
land and ocean. The differences in the instrument spatial cov- 
erage show how rarely (or how often) there are coincidences 
between the datasets. There are few coincidences between in- 
struments with narrow swaths (like AATSR vs MISR), while 
geostationary instruments (SEVIRI) and polar orbiters with 
a large swath (such as OMI) can give a near complete cover- 
age of the geographic area and have a large number of coin- 
cidences with both other satellite datasets and AERONET. 

Some care must be taken when comparing the differ- 
ent results in Fig. 1. For instance, AIRS provides AOD at 
900 cm -1 ; it is included in the comparison because it can 


Table 3. AERONET sites considered in the comparison: name, lat- 
itude, longitude and type (land or coast). The same sites are shown 
in Fig. 3. 


SITE 

lat. 

long. 

type 

Agoufou 

15.34 

-1.48 

land 

Banizoumbou 

13.54 

2.67 

land 

Capo Verde 

16.73 

-22.94 

coast 

Dakar 

14.39 

-16.96 

coast 

Djougou 

9.76 

1.60 

land 

IER Cinzana 

13.28 

-5.93 

land 

Saada 

31.63 

-8.16 

land 

Santa Cruz Tenerife 

28.47 

-16.25 

coast 

Tamanrasset TMP 

22.79 

5.53 

land 


provide information on AOD of large particles, but a direct 
comparison with visible AOD (which is far more sensitive to 
smaller particles) can be misleading. To make a direct com- 
parison, one could rescale the infrared AOD to an effective 
value at 550 nm, assuming a specific size distribution. Po- 
tentially, the different sensitivities of the two ranges could 
be used to infer information on the size distribution, as at- 
tempted by the ORAC-SEVIRI scheme. Similarly, POLDER 
data over land are particularly sensitive to sub-micron aerosol 
particles and not the total optical depth. 

Here the AIRS AOD and POLDER over land AOD are 
presented without attempting to scale to optical depth at 
550 nm. In scatter plots with other datasets, the “ideal slope” 
for these instruments is not expected to be one, and if the 
relative amount of small and large particles changes over the 
scene, then the correlation will be less than one. 

Figure 2 shows the monthly AOD obtained by averaging 
daily 0.5 x 0.5 degree gridded data. Monthly mean dust AOD 
varies enormously between the datasets. Even over the ocean, 
where all the retrievals are expected to be more accurate, the 
monthly AOD inside the area affected by dust (south-west 
area of the plots) varies from 0.5 (MERIS and SEAWIFS) 
to 2 (ATSR-ORAC). Some differences are due to instrument 
sampling, but a large effect arises from the quality control 
applied to screen the data for “valid” retrievals, as differences 
between the two OMI datasets show very clearly. MERIS, 
SEAWIFS and SEVIRI-GLOB frequently cut the dense part 
of the plume, and this is reflected in the low monthly average 
AOD. 

The AIRS AOD retrieval algorithm is extremely sensitive 
to the assumed height of the dust layer. In addition, over land, 
since the algorithm uses window channels, the emissivity of 
the underlying land can impact the retrieval for cases of low 
optical depth. One limitation of MODIS Deep Blue Collec- 
tion 5 is that the surface reflectance database is static and 
this can be a source of regionally/seasonally dependent er- 
ror; elevated terrain can also lead to biases as pressure is 
not accounted for explicitly. The surface reflectance model 
has been improved for the forthcoming MODIS Collection 
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Fig. 4. Example of a scatter plot between AERONET data (x) and satellite (y) for SEVIRI-ORAC. The black/brown symbols are satellite 
datasets (y) vs. AERONET AOD (x). Different locations are represented by different symbols, as with Fig. 3. The red stars represent two 
times the AERONET Angstrom coefficient (between 440 and 870 nm). The final plots show all the coincidences. In every scatter plot with 
more than four coincidences, there are captions indicating the best linear fit (angular coefficients, y intercept and associated errors), the 
correlation coefficient (CC) and the root-mean-square differences (RMSD). 
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Fig. 5. Scatter plots, satellite datasets AOD (y) vs. AERONET AOD (x), for all the available coincidences. Different locations are represented 
by different symbols, as defined in Fig. 3. In every scatter plot, there are captions indicating the best linear fit (angular coefficients, y intercept 
and associated errors), the correlation coefficient (CC) and the root-mean- square differences (RMSD). 
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Fig. 6. Example of comparison over land, MISR vs. other datasets. In every scatter plot, there is a caption: the first line indicates the 
correlation coefficient (CC), the root-mean- square differences (RMSD) and the number of coincidences ( n ); the second line presents the 
best linear fit. 
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Fig. 7. Example of scatter plots over ocean, POLDER-OCEAN vs. other datasets. In every scatter plot, there is a caption: the first line 
indicates the correlation coefficient (CC), the root-mean-square differences (RMSD) and the number of coincidences ( n ); the second line 
presents the best linear fit. 
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Table 4. Summary of AOD comparisons for three cases: “all”, “very dusty” and “clean” coincidences. “A” is the numbers of coincidences, 
“CC” the correlation coefficient and “bias” is the absolute mean difference between AERONET and satellite AOD. 



All coinc. 

Very dusty 

Clean 

Dataset 

N CC Bias 

N CC Bias N 

CC Bias 


AATSR-GLOB 

AATSR-ORAC 

AATSR-SWA 

MERIS-LOV 

MISR 

MODIS 

OMI-KNMI 

OMI-NASA 

POLDER-LAND 

POLDER-OCEAN 

SEAWIFS 

SEVIRI-IMP-IR 

SEVIRI-IMP-VIS 

SEVIRI-ORAC 


34 

0.919 

0.136 

38 

0.829 

0.118 

49 

0.593 

0.316 

11 

0.775 

0.106 

23 

0.957 

0.092 

87 

0.949 

0.180 

104 

0.911 

0.189 

101 

0.660 

0.202 

62 

0.862 

0.517 

18 

0.995 

0.105 

23 

0.763 

0.096 

64 

0.907 

0.284 

11 

0.994 

0.085 

136 

0.871 

0.242 


8 

0.898 

0.362 

8 

0.743 

0.156 

18 

0.631 

0.467 

3 


0.211 

2 


0.493 

27 

0.954 

0.386 

27 

0.907 

0.306 

17 

0.711 

1.320 

8 

0.995 

0.150 

8 

0.014 

0.119 

16 

0.963 

0.412 

3 


0.187 

37 

0.890 

0.475 


9 

0.581 

0.060 

8 

0.728 

0.061 

10 

- 0.728 

0.429 

2 


0.029 

4 


0.036 

18 

0.836 

0.037 

17 

0.081 

0.116 

8 

0.693 

0.088 

0 



2 


0.088 

7 

0.952 

0.316 

4 


0.040 

27 

- 0.265 

0.133 


6, which will decrease this potential error source. AATSR 
ORAC and SWA have significant better coverage, compared 
with the same instrument dataset from AATSR-GLOB, due 
to the better representation of the surface reflectance. A limi- 
tation of the MISR dataset is the smoothing mask used in the 
current version of land retrievals that eliminates high AODs 
leading to AOD underestimation at high aerosol loading (a 
problem for heavy dust events). POLDER retrievals are lim- 
ited over land by the weak sensitivity to the coarse-mode 
making it impossible to estimate the total AOD, but neverthe- 
less present a good correlation with AERONET data. OMI- 
KNMI is a more complex algorithm than OMI-NASA that 
makes use of a wider spectral range and fits several aerosol 
parameters in the retrieval. It has a better coverage of the dust 
plume compared to OMI-NASA, and, in comparison with 
the other dataset, OMI-KNMI tends to give higher AOD in 
the southern part of the region considered in this compari- 
son. MERIS, SEAWIFS, and SEVIRI-IMP-VIS all use vis- 
ible channels to retrieve the aerosol loading making it diffi- 
cult to overcome the problem of dust retrieval over bright sur- 
face, so these datasets are applied only over ocean. Neverthe- 
less, MERIS and SEAWIFS tend to miss the dust plumes due 
to presumably too strict quality control while SEVIRI-IMP- 
VIS is able to follow them. SEVIRI-GLOB uses VIS-NIR 
channels and is applied both over land and ocean but does 
not cover bright surfaces and also tends to miss the thicker 
part of the dust plume due to quality control. SEVIRI-IMP- 
IR is applied over land and uses only infrared channels. It 
works best if the dust loading is relatively large and is less 
certain when there is little dust in the atmosphere, because 
it is more dependent on meteorological data. SEVIRI-ORAC 
is a first attempt to overcome the problem of bright surfaces 
using VIS and IR channels together, but due to the simple 
treatment of surface emissivity, the main issue is an overes- 


timation of AOD over desert in clean conditions, which is 
attributed to errors in the modelling of surface properties. 


4 AERONET comparison 

A comparison between AERONET level 2, cloud-screened 
and quality-assured, ground data (Holben et al., 1998; 
Smirnov et al., 2000) and co-located values for each satel- 
lite dataset has been made. Here it is essentially assumed 
that variability in time is somehow related to variability 
in space (Ichoku et al., 2002), and an average of all the 
valid satellite retrievals over a 50 km radius around each 
AERONET site has been made. To match the data spec- 
trally, the AODs at 550 nm (T550) are obtained using AOD 
at 440 nm (T440) and Angstrom coefficient between 440 and 
870 nm (a) according to 


G50 = ?440 



( 2 ) 


All the AERONET AODs within an interval of half an hour 
from the satellite overpass time (i.e. a time window of 1 h) 
have been averaged, and all the coincidences with at least two 
AERONET measurements within this time have been con- 
sidered. Note that not all satellite datasets have 550 nm in the 
spectral range used in the aerosol retrieval: in this case, the 
AOD at 550 nm is extrapolated, and this can amplify errors. 
All the AODs in the AERONET comparisons are reported at 
550 nm except for OMI-NASA, which is reported at 440 nm. 
Some datasets (see Table 1) have values only over ocean so 
the comparison is possible only with coastal sites. 

Figure 3 shows the location and the symbols that will be 
used in the scatter plots (Figs. 4 and 5) for the AERONET 
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Fig. 8. Correlation coefficient obtained with the comparison of datasets vs. datasets. Values above the diagonal are for data over land, below 
the diagonal are over ocean. 
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Fig. 9. Root-mean-square difference between different datasets. Values above the diagonal are for data over land, below the diagonal are over 
ocean. 
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Fig. 10. Combined daily AOD for the first 30 days of March 2006. 
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Fig. 11. Evolution of individual dataset AODs and averaged values (black line) as function of day of March 2006. 


sites considered. Their coordinates are tabulated in Table 3 
together with a classification of land/coast site. 

Figure 4 shows an example of satellite vs. AERONET 
scatter plots for SEVIRI-ORAC. The scatter plots are given 
for the individual AERONET sites, allowing regional and 
local issues to be identified. A summary plot is produced 
using all the coincident data available in all the locations to- 
gether. On each plot, red stars show the value of two times the 
AERONET Angstrom coefficient (between 440 and 870 nm). 
These values can help to qualitatively distinguish the desert 
dust measurements (low values) from the smaller particles 
(high values). 

The vertical error bars are the standard deviation (STD) 
of the satellite measurements (within the area around the 
AERONET station). The horizontal error bars are the 
standard deviations of the AERONET measurements (within 
the 30 min around the satellite time). 

Figure 4 shows that, for AODs values higher than one, 
SEVIRI-ORAC underestimates the AOD, and does so more 
over land than over ocean. Looking at the sites with AOD 
higher than 1, Cinzana and Banizoumbou (land sites) exhibit 
a larger underestimation, Dakar (on the coast) an intermedi- 
ate case, and Capo Verde (an island in the ocean) has a slope 
close to 1 . This behaviour could be the result of imperfect 
land surface modelling or imperfect modelling of the dust 
spectral optical properties. Note that the IR channels have 


more importance in the SEVIRI-ORAC retrieval over land 
where the visible channels (high surface reflectance) are as- 
sumed to be more affected by errors, so correct modelling of 
the IR optical properties becomes more important over land. 

The Saada site appears to be outside the desert storm of 
March 2006 as shown by the consistently high values of 
Angstrom coefficient. Note that Tamanrasset is at an altitude 
of 1000 m, which could explain why its observations are bi- 
ased compared to nearby satellite observations. In the case of 
a desert plume flowing close to the surface (common during 
winter time), dust can flow around Tamanrasset and result in 
a significant amount of dust below the AERONET site. 

Similar analyses have been performed for each of the 
datasets against coincident AERONET measurements: a 
summary is presented in Fig. 5. 

POLDER over land is included for completeness, but one 
should take into account the fact that the polarisation-based 
measurement is sensitive only to small particles (fine mode), 
so the resulting AOD is a fraction of the total aerosol AOD. 

Figure 5 shows all the coincidences together for all the 
datasets available in order to check the overall quality of the 
satellite retrievals. Not surprisingly, the best agreements are 
for coast AERONET sites (Capo Verde, Dakar and Tenerife) 
and ocean only datasets (MERIS-LOV, POLDER-OCEAN, 
SEAWIFS, SEVIRI-IMP-VIS) where the retrieval is more 
accurate than over land. With the datasets that consider both 
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Fig. 12. Combined daily AOD vs. AERONET. Equivalent of Fig. 4 but obtained considering the combined AOD instead of a single satellite 
dataset. Different locations are shown in different plots and are represented by different symbols, as with Fig. 3. The red stars represent two 
times the AERONET Angstrom coefficient (between 440 and 870 nm). The final plots show all the coincidences. 
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ocean and land, apart from OMI datasets, there is a tendency 
to underestimate the AOD, especially for high AOD (values 
more than 1) and low Angstrom coefficients, conditions that 
are a good indication of dust. This can indicate that there is 
a need to improve dust optical properties and surface char- 
acterisation over land. Satellite retrievals in dust-dominated 
regions tend to overestimate instantaneous AOD in the low 
AOD range and underestimate it in the high range compared 
to AERONET (as already documented for MISR in Kahn 
et al., 2010). A greater diversity of dust optical models is 
needed to better represent different desert source regions, 
though other factors might also be involved. 

A similar analysis has been performed with only the co- 
incidences where AERONET Angstrom coefficient is lower 
than 0.7 in order to test the satellite retrieval in dust con- 
ditions only. Apart from decreasing the numbers of coinci- 
dences (removing nearly all data in the Saada site), these re- 
sults show little variation, less than 10 % in correlation coef- 
ficient (CC) and root-mean-square differences (RMSD), and 
are not substantially different from Fig. 5. 

A similar analysis has also been performed for the very 
dusty conditions (Angstrom coeff. < 0.4 and AOD > 0.5) and 
clean conditions (Angstrom coeff. > 0.7 0.4 and AOD <0.5). 
Table 4 summarises the AERONET comparisons in terms 
of number of coincidences, CC and bias with AERONET 
(where bias is the module mean difference between 
AERONET and satellite AOD), for the three cases: “all” co- 
incidences (as data show in Fig. 5), “very dusty” condition 
and “clean” condition. Correlation coefficients are computed 
only for cases with more than five coincidences. 

Some datasets specifically developed for dust (SEVIRI- 
IR, SEVIRI-ORAC, MODIS) improve the CC between “all” 
and “very dusty” conditions, but the bias with AERONET 
increases. This could indicate that they can follow the dust 
storm better than all the other conditions, but not with the 
same accuracy. In all datasets, the bias increases in “very 
dusty” condition compared to “all” conditions, indicating 
that future work should be done to improve the retrieval in 
very dusty conditions. Results for “clean” conditions show 
obvious weakness in terms of CC for AATSR-SWA and 
SEVIRI-ORAC, but this was not the focus of this inter- 
comparison. For example, SEVIRI-ORAC is only performed 
with the dust aerosol type which is not expected to repre- 
sent well clean conditions. The datasets that give better re- 
sults for all conditions are MISR, POLDER-OCEAN, and 
SEVIRI-IMP-VIS. Though note that the last two are ocean 
only datasets. MISR is possibly the dataset that performs best 
in all conditions (over ocean and land), but the limited cover- 
age does not allow the quality under “very dusty” conditions 
to be tested in this study. 

A comparison with AERONET is useful to assess the 
quality of the retrievals, but the quality control applied by 
AERONET limits the comparison to cloud-free conditions, 
and so the numerous cases in which the satellite retrievals are 
cloud contaminated are not assessed. Furthermore, note that 


Table 5 does not distinguish between land and ocean/coastal 
sites which penalises datasets with more coverage over land. 


5 Satellite inter-comparison 

After the single datasets have applied their own quality con- 
trol, for each day we compare, one by one, each dataset 
against the others. For every dataset, grid boxes with two or 
more measurements and standard deviation less than 0.5 have 
been considered. Figures 6 and 7 show examples for MISR 
over land and POLDER over ocean. The summary in terms 
of CC and RMSD is shown in Figs. 8 and 9. 

The line over-plotted in the density plot is obtained with a 
linear fitting procedure, considering every latitude-longitude 
box mean AOD, and taking the related AOD STD as error. 
In the scatter plots, the values of CC, RMSD and best fit are 
also indicated. The comparison is performed separately for 
land and ocean. 

In Figs. 8 and 9, the values above the diagonal refer to the 
comparison over land; the values below the diagonal refer 
to comparison over ocean. As expected, over ocean CCs are 
higher and RMSDs are lower. 

AATSR and MISR are most correlated with each other, 
possibly because both exploit multi-angle viewing and be- 
cause the local time of measurement differs only by half an 
hour. Figures 8 and 9 do not show any particular “time ef- 
fect”; for example, if the difference in time of measurement 
plays a dominant role in this intercomparison, it would be ex- 
pected that POLDER/OMI/AIRS (overpass at 13:30) would 
differ more from ATSR/MISR (overpass at 10:30) and they 
would agree better with each other, but this is not reflected in 
terms of CC and RMSD. 

The comparisons with AERONET (Sect. 4) show better 
results than the satellite-to-satellite AOD inter-comparisons. 
This has been previously documented for MISR and MODIS 
(Mishchenko et al., 2007, 2010; Tanre, 2010). It is explained 
by considering AERONET AOD as ground truth. Each satel- 
lite AOD dataset has a confidence envelope spread around 
this “truth”. When comparing any pair of satellite datasets 
directly, we cannot consider one as truth. For MISR and 
MODIS specifically, assumptions made in each algorithm 
mean that one instrument tends to overestimate AOD in spe- 
cific situations where the other underestimates AOD. The re- 
sult is that the satellite-AERONET envelope for each instru- 
ment is smaller than the envelope produced by comparing 
the two satellite instrument datasets directly; when the confi- 
dence envelopes are convolved correctly, the differences be- 
tween MISR and MODIS are actually slightly smaller than 
might be expected from the individual instrument compar- 
isons with AERONET (Kahn et al., 2009a). Nevertheless, the 
more likely reason why the comparisons with AERONET 
show better results than the satellite-to-satellite is presum- 
ably due to the fact that AERONET itself provides a strin- 
gent quality control and the resulting AERONET vs. satellite 
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Fig. 13. Daily map for 8 March 2006 of the combined AOD (top left), the number N of instruments considered for every box (top right), 
standard deviation STD (bottom left) and ratio between standard deviation and aerosol optical depth STD/ AOD (bottom right). 
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Fig. 14. Monthly average of AOD (top left), number N of instruments considered (top right), standard deviation (bottom left) and ratio 
between standard deviation over AOD (bottom right). Values in black are higher than the maximum of the colour bar. 
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comparisons are in cloud-free conditions, while the satellite- 
satellite results can be cloud contaminated. 


6 Combined dataset 

Because of the non-complete coverage of any single satellite 
dataset, it is helpful to follow the behaviour of dust plumes 
during March 2006 using a combination of all the different 
satellite datasets available. A combination weighted with er- 
ror estimates would be the best way to characterise these dust 
events, but at present a complete quality assessment study for 
every dataset in every condition is not available. 

In this work, a combined dataset is obtained using a simple 
average (as explained further below). It is used to analyse 
where there are the most discrepancies between datasets: this 
can be used to indicate which areas need improvement. 

The average of all the datasets has been assimilated into 
the transport model SHAMAL to better understand dust 
transport (Banks et al., 2009; Banks 2010). 

For each grid box and for each day of March, 2006, the 
satellite retrievals were averaged to create a daily mean “all 
retrievals” field. If the satellite instruments have more than 
one algorithm, the different algorithm results are averaged 
first for the same instrument, and then successively the aver- 
age between the different instruments is performed. This is 
in order to avoid weighting more heavily an instrument with 
several datasets (for example, SEVIRI has four datasets in 
this comparison). 

For each grid box, a daily average was calculated. Suc- 
cessively averaging these daily values gives monthly means. 
Figure 10 shows the daily average AOD obtained for 
March 2006. The daily average AOD from all datasets shows 
very good continuity, including at the coastal boundary and 
between areas with different numbers of datasets. 

Fig. 11 shows the time evolution of the daily average AOD 
together with the values of all the datasets available, for two 
subregions selected as examples of dust plumes over ocean 
(between 11° and 12° N, —20° and — 21° E) and over land 
(between 15° and 16° N, 5° and 6° E). 

To check the quality of the combined dataset, a compar- 
ison with AERONET is produced in the same way as the 
individual dataset comparisons (e.g. Fig. 4). This is pre- 
sented in Fig. 12. In this case, AERONET data are consid- 
ered over a longer time interval, from 10:00 a.m. to 2:00 p.m., 
and, spatially, all the combined AODs that have the central 
grid box within 50 km of the AERONET site are consid- 
ered (between one and four combined AODs are averaged 
in this comparison, depending on location). Values of CC 
and RMSD for the combined datasets are in the same range 
as the single dataset comparisons with AERONET. The er- 
ror bars for single datasets are often larger in both axes, x 
and y, due to larger STD in satellite-combined AOD, and the 
larger variations in AERONET AOD inside the wider time 
interval. Once again, the best comparisons are obtained for 


coastal sites (Capo Verde, Dakar and Tenerife) and we notice 
an underestimation of AOD at high AOD and low Angstrom 
coefficient. 

Figure 13 shows the daily average AOD of all datasets for 
8 March 2006, the numbers of instruments averaged in every 
box, STD and the ratio STD/AOD. The STD gives a measure 
of AOD differences between instruments: it can be seen as an 
uncertainty of AOD given by the difference in instruments, 
algorithms and aerosol models considered. The STD is gen- 
erally, as expected, higher where the AOD is higher and in 
correspondence with the dust plume both over land and over 
ocean areas. It is not particularly related to the number of 
measurements used. The value of STD/AOD can be seen as 
relative error: when it is larger than 1, it visualises where the 
spread between instrument values (STD) is higher than the 
AOD itself. Over ocean, the higher area corresponds to the 
plume itself and to pixels that may be affected by cloud con- 
tamination. Over land, the higher values occur where there 
is more likely to be uncertainty on surface characterisation 
(bright surface for the north of Africa) and again where there 
may be cloud contamination (the southeastern part of the 
plot). Some satellite cloud masks cannot distinguish water 
cloud from thick aerosol, so “cloudy conditions” for some 
retrievals might actually be dust. 

Figure 14 presents the average over the month of all the 
images in Fig. 13. 

Starting from the daily values, the averages over all the 
days have been computed in order to obtain the monthly val- 
ues presented in Fig. 14. The plot of monthly STD shows the 
variation of AOD between datasets. As expected, it is related 
to the behaviour of AOD itself, and is higher where the AOD 
is higher. So in the monthly means, we have a higher dis- 
persion of AOD values in the areas of higher average AOD 
conditions. The area in the bottom part of the plot over Africa 
(Nigeria approximately) is definitely an area overpassed by 
the March 2006 dust plume, but it is also where we have 
significant data screened out due to cloudy conditions (low 
values of N in both monthly means and daily plots), so the 
large dispersion of AOD could be attributed to cloud. 

The values of STD/AOD are shown in the spread of the 
data compared to the AOD itself, over the whole month. 
Looking at this plot together with the plot of N (average 
number of dataset/measurements), it is possible to note that 
there are higher values where there are fewer measurements. 

Over land, STD/AOD is larger than 1 in the region where 
we are presumably more affected by cloud contamination 
(southern part of the plot) and there is an area of consis- 
tently high values (0.7-0. 8) corresponding to a bright sur- 
face. Unfortunately, there is a lack of AERONET stations in 
this region. 

Over ocean, the higher values are less localised and more 
“noisy” but surprisingly reach comparable values. 
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7 Conclusions 

This intercomparison has been valuable for identifying some 
deficiencies in retrieval schemes. For example, with SEVIRI 
ORAC the main issue is a bias over desert in clean condi- 
tions, which is attributed to error in the modelling of surface 
properties. 

All datasets show a reasonably good agreement with 
AERONET. Typically, the standard deviation of observations 
with respect to AERONET is around 0. 1-0.2. Discrepancies 
between satellite datasets are larger than this agreement with 
AERONET would imply. This is possibly due to the fact that 
AERONET itself provides a stringent quality control. 

The standard deviation between datasets is higher in the 
desert dust plume and sometimes is comparable with the av- 
erage AOD itself. However, the dispersion (standard devia- 
tion) of the AOD values between datasets compared with the 
average AOD itself (STD/ AOD) presents higher values con- 
sistently, for the period considered, over the area of bright 
land surfaces. Unfortunately, over such regions there is a par- 
ticular lack of AERONET stations. 

The additional information (e.g. extending the spectral 
range used to UV or IR channels), which allows some 
datasets to work over bright surfaces, at the same time in- 
troduces problems due to variability of parameters that par- 
ticularly affect these schemes (e.g. the dust optical model and 
surface properties). There is a need for improved dust optical 
properties and better characterisation of land surface proper- 
ties over a broad spectral range. Comparisons should also be 
extended in the future to consider the aerosol models used in 
the different retrieval schemes. 

There are remarkable differences in the spatial coverage 
of the daily products obtained with the individual satellite 
datasets, and this is due to differences in satellite coverage 
(overpass time, swath) and quality control data cuts (the last 
one is apparent from the plot of different datasets for the 
same instrument in Fig. 1). And, even if a pixel-by-pixel 
comparison has not been performed in this paper, the differ- 
ences in spatial coverage have been found to make important 
contributions to the monthly mean differences. 

Removal of data for quality control is one of the more im- 
portant sources of such differences. For example, monthly 
means over ocean from the same satellite (but different 
datasets/algorithm) still show discrepancies. To a lesser ex- 
tent, differences are also produced by differences in aerosol 
model and retrieval algorithm used. With the intention of 
avoiding clouds, some datasets make very restrictive data 
cuts and cut the densest parts of the plume, which leads to 
a large bias in the monthly mean. 

Every single dataset has some weakness due to the single 
instrument characteristic and to the algorithm itself, but the 
combined AOD from all datasets for March 2006 shows very 
good spatial continuity, in particular over the coastline and 
over boundaries where the number of contributing datasets 
changes. 


This encouraging result from such a simple method sug- 
gests that the best way to characterise an aerosol event is 
to exploit the complementary capacities of different sensors. 
The development of more optimal techniques to perform this 
merging could be an interesting topic for further research. 

All the datasets used in this comparison are available at: 
ftp ://ftp. atm. ox. ac .uk/pub/user/elisa/DRI/. 
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